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A study designed to develop a selection model for the 
prediction of Signalman performance in sending and receiving Morse 
code and to evaluate training strategies was conducted with ISO Navy 
and Coast Guard enlisted men. Trainees were taught to send Morse code 
using innovative training materials (mtemonics and guided practice). 
High and average aptitude groups were compared on code learning and 
performance factors in relationship to traditional vs. innovative 
materials. The Armed Services Aptitude Battery (ASVAB) and nonverbal 
tests (Visual Pattern Discrimination--VPD--and Visual Eeaction 
Time--VBT) were used to predict performance. Mnemonics and guided 
practice proved superior to traditional training materials for 
learning Morse code, but the type of training materials had nc 
significant effect on ability to send and receive messages. The ASVAB 
tests were good predictors for high aptitude individuals, while the 
VPD proved the best predictor for the lowest quartile. As a result of 
the study, the following training model was proposed: (1) VPD as well 
as other tests for screening low and average aptitude applicants; (2) 
self-paced instruction: (3) VFE exercise used as orientation for code 
reception: m) examination of validity of course entry requirements. 
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SUMMARY OF THE STUDY 

A study was conducted to develop a selection model for the prediction of 
Signalman performance in sending and receiving Morse code and to evaluate 
several training strategies designed to enhance the learning of Morse code. 
The trainees were 180 Navy and Coast Guard enlisted males. Trainees were 
divided into four groups based on aptitude (High vs. Average) and instructional 
materials (traditional vs. innovative). The predictor battery for code acquisi 
tion consisted of age, education, and the WK, AR, AD, and MC subtests of the 
Armed Services Aptitude Battery (ASVAB). Non-verbal Visual Pattern Discrimina- 
tion (VPD) and Visual Reaction Time (VRT) were used as predictors of performanc 
in receiving and sending code. 

In general. High aptitude personnel learned Morse code at a faster rate 
than Average aptitude personnel. However, while the innovative training 
strategies (guided practice, mnemonics) enhanced the learning of all trainees, 
the most significant gains were made by Average aptitude trainees (see section 
III of this report) . 

The High aptitude group also performed significantly better than the 
Average aptitude group in receiving code via flashing light even though both 
groups achieved criteria performance in the code acquisition phase of the 
study. This suggests that current training strategies do not sufficiently 
accommodate variations in trainee aptitudes. 

The WK and AR subtests of the ASVAB, which are currently used for assign- 
ment to the Signalman course, are good predictors of acquisition of code and 
reception of code via flashing light. However, the non-verbal Visual Pattern 
Discrimination Test (VPD) proved to be the best predictor of performance via 
the flashing light for the lowest quartile of personnel (as measured by WK and 
AR subtests) (see section IV of this report). 

A training model is proposed which would maximize performance for all 
.aptitude groups. The following recommendations are made (see section V of 
this report): 

• A Visual Pattern Discrimination test be added to the selection 
battery for screening of Average and Low aptitude individuals 
being considered for Signalman training. 

• Self-paced instruction be adopted to accelerate training of High 
aptitude trainees and permit lower aptitude trainees time to attain 
task mastery. 

• The Visual Pattern Discrimination exercise be used for orientation 
to code reception via flashing light. 

• The validity of current entry requirements should be examined. This 
recommendation is based on the finding that waivered students 
utilized in this study performed successfully. 
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SECTION I 
INTRODUCTION 

nntonlJ^i^r^ searching for improved ways to (1) identify personnel with 
potential for specific occupations and (2) develop training strategies which 
will maximize individual capabilities. In order to devise suitable training 
strategies, individual aptitudes must be accounted for in the training design. 
I5rto^c^.^"r^-*^r!/-f ve^^^lly loaded aptitude tests as the principal pre- 
tllll I I "ability, and there has been a growing concern as to whether 
iSSw accurately reflect an individual's potential for success in many 
nnnL^h! "? \ 5^ research reported herein relates performance on verbal and 
nonverbal tests to performance in the training of a Morse code task for signal- 
was *J?^.Jph-^"'" ?! individual background data! 
HnLf^ *° ^""P^ov^ the selection and classification proce- 
dures currently in use for assigning Navy signalmen to training. 

BACKGROUND 

sfidv^Hv lltt ^L^S""'! "Jfol^f"'!^? ' ^^'^^^^y beginning with the classical 
study by Bryan and Harter (1897). The most extensive studies in code learning 
are probably those of Keller and his associates (1943-1945) which led to [Ke 

2aw'ZH"?;l3^J^' "^^^^^ ^^°P*^^ war Depar^me t The 

?each Sorsl ^niS'^o'^*^-'' and has periodically sought more efficient ways to 
teach Morse code to radiomen (Robins, 1958; Rulon & Brooks, 1960). 

.nHo ^^'^ t5?^"»st part, research efforts have concentrated on the use of Morse 
code n auditory rather than visual communication as used by signalmen. Navy 

It?niTJ?^"r^'°^?-J° "'"^^9" ^^^^^^'"9 signals by manl^u- 

emits^?c^ n^.^p^^rJ-^l ''^^I'^ P^!^^^ °^ a light source which 

emits light flashes of different duration to produce a series of dot-dash 
patterns. The series of dots and dashes represents letters and finally words 
and sentences which comprise a meaningful message. Tinauy woras 

.inn.?;^pr*^{; ^^'^'^''^^ leaming of Morse code by Navy 

anH n;^n?;vp ^^^^ study, innovacive strategies (mnemonics and guided learning 
^p^^S.-n were employed to enhance code learning. Mnemonics plus guided 

learning and practice was found to be a most effective strategy for increasing 
the general achievement level of trainees. The strategy virtually eliminated 
differences in code acquisition resulting from variations in aptitude level 
?rrriw?nn%°I.P'''c*u"- "S^'^ver, even though all trainees learned the code 
to .enter on (after 6 hours of practice), there were significant differences 
-K f°i]°w-on performance phase (receiving Morse code via flashing light) 
attributable to aptitude levels as measured by the Armed Services Vocatona 
Aptitude Battery (ASVAB) subtests which are used to assign ind"?dua" lo 
signalman training These paper and pencil tests measure a limited portion of 
an individual s abilities; namely, those implicit in verbal skills, r per and 
pencil tests work quite well for selecting and training 60 to 70 percent of 
entering military personnel. For the remaining 30 to 40 percent (many of whom 
are average or below average in ability), these classification procedures are 
grossly inadequate and provide little information on how individuals mav 
best be utilized. ^ 
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While there is recognition that valid relationships may exist between 
aptitude test scores and success in the academic setting, the predictive 
relationship between these tests and actual job performance is less clear. 
With regard to signalman training, the staff has expressed concern that 
selection tescs currently in use may not reliably predict speed and accuracy 
in receiving Morse code visually. These tests are apparently valid predictors 
of the completion of the cognitive portion of the training curriculum, but 
there is some doubt as to their effectiveness in predicting performance. 

It is generally recognized that nonverbal measures are extremely valuable 
in providing information concerning an individual's capabilities. Non- 
verbal tests, when added to the selector aptitude indexes, add a significant 
and unique contribution to the prediction of technical training school 
success (Wiskoff, 1977; Anastasi, 1950; and Wil bourn, Quinn, and Leisey, 



PURPOSE 

The present study was designed to identify specific non-verbal individual 
factors which may account for the differential performance of various 
aptitude groups (trained to criteria in the Ainsworth (1979) study) in the 
reception of visual Morse code and to validate selection tests currently 
utilized for the assignment of signalmen. 

ORGANIZATION OF THE REPORT 

In addition to this introduction, thfe report contains four sections and 
five appendices. Section II contains a description of the study design, 
trainee population, the learning tasks, training materials, and study and 
analysis procedures. Section III summarizes the results of the study 
including performance differences between treatment groups, intercorrelations 
of the predictor and criteria variables, predictor models for each of the 
performance phases of the signalman course and final school grade, and 
course attrition. Section IV discusses the validation of the ASVAB subtests 
used for signalman selection, personnel characteristics related to the Morse 
code task, and course attrition. An instructional model for signalman 
training is provided. Section V provides conclusions and recommendations 
for course managers. 

Appendix A contains a description of the Armed Services Vocational 
Aptitude Battery with corresponding reliability coefficients. The types of 
training materials used in the study are described in appendix B. Appendix 
C is a copy of the pattern discrimination exercise instructions given to the 
staff and trainees. Appendix D contains the Analysis of Variance Source 
Tables. The statistical data are discussed in appendix E. 
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SECTION II 
STUDY DESIGN 

This section contains a description of the study design, trainee popula- 
tion, learning tasks, and study procedures. 

The study was designed to assess the differential effects of aptitude 
levels, type of training materials, and amount of practice time on receiving 
Morse code messages via flashing light at five words per minute. Trainees 
were divided into two groups of High and Average aptitude, with the High 
aptitude trainees having a combined WK + AR score of 115 or greater on the 
ASVAB and the Average trainees having a combined WK + AR score of less than 
115. The cutoff score on the ASVAB was arbitrarily chosen at 115 because it 
is approximately 1 standard deviation above the normalized, composite mean 
of 100. Four types of training materials were employed for the code acquisi- 
tion. These are discussed in detail later in this section. For the performanc 
phase, the length of practice training was 4 and 5 weeks in receiving coded 
messages via a mechanically operated, tape-driven flashing light apparatus. 

TRAINEES 

The trainees were 180 Navy and Coast Guard enlisted males with a mean 
age of 19.5 years (range 17-30) and a mean of 11.8 years of formal education 
(range 9-16). Academic ability was measured by the ASVAB which is administered 
to each new military accession. A General Technical Composite score was 
obtained by summing the scores on two subtests. Word Knowledge (WK) and 
Arithmetic Reasoning (AR). Each subtest has been normalized to a mean of 50 
and a standard deviation of 10. The WK and AR composite mean is 100 and the 
standard deviation of the composite scores is 15. (Appendix A contains a 
list of subtests with corresponding reliability coefficients.) The WK and 
AR composite scores of the study group ranged from 99 to 143. It can be 
inferred that the trainees were average and above average in general intelli- 
gence. A composite WK and AR score of 105 is required for entry into the 
signalman school. Occasionally waivers are given, depending upon billet 
requirements and human resources supply. 

^ All trainees included in the analyses completed the 6-week Signalman 
'A School at the Service School Command, Naval Training Center, Orlando, 
Florida. Twelve consecutive classes were used, with a new class convening 
every other week. 

THE LEARNING TASKS 

The learning tasks were (1) the acquisition of the International Morse 
Code and (2) sending and receiving code via flashing light. The code consists 
of 42 sight patterns which include 26 letters, 10 numerals, and 6 punctuation 
marks. A 100 percent understanding of the code is essential for effective 
communication utilizing flashing light. In the acquisition training phase, 
the trainee must learn the patterns, the alphabetic equivalent, and the 
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phonetic equivalent (b=bravo) since s/he must perceive the code, interpret, 
and verbally relay the message to a "copier." In performance, the trainee 
must send and receive code via flashing light; i.e., recognize the letters and 
form a message, 

TRAINING MATERIALS 

The training materials used in this study were developed by Aagard and 
Braby (1976). These materials were formatted in four ways. Table B-1 in 
appendix B depicts the four formats with respect to their learning guideline 
content. Traditionally, training materials for Morse code have included 
printed lists of the code and its alphanumeric meanings (lists are printed on 
a student guide, on a hand-held cardboard flasher, and on flash cards) and 
printed lists of opposite codes (such as .- for A and for N) and similar 
codes (such as . for E and .. for I, - for T and — for M). Trainees have 
traditionally learned the code using self-generated learning strategies. One 
group of trainees learned the code using the traditional (Type 1) materials. 

The second group of trainees was given a handbook with the procedural i zed 
learning technique of chunking (or part learning), guided practice, intermittent 
feedback, and self- tests (Type 2 materials). Memory aids were not provided, 
so the 42 paired-associates were typically rote-memorized. 

Group 3 trainees were given a 13-page handbook presenting Morse code 
symbols in six sets (Type 3 materials). There were no practice exercises or 
self- tests, and there were no combined exercises or criterion tests. Memory 
aids were provided. The handbook procedural i zed the learning technique of 
verbal-pictorial mediation but did not involve chunking, guided practice, or 
intermittent feedback. 

Group 4 trainees were given a booklet utilizing the principles used in 
booklets 2 and 3, mnemonics, chunking, guided learning and practice, and a 
self- test. The 137-page handbook procedural i zed chunking, guided practice, 
and intermittent feedback as well as verbal-pictorial' mediation (Type 4 
materials), 

PROCEDURE 

ACQUISITION PHASE. The study was conducted in the operational environment 
where it is often difficult to exercise the same rigid controls that are 
possible in the experimental laboratory. For this reason, a controlled 
study period was incorporated into the design. Training materials were 
distributed and three 2-hour study periods were conducted with the experi- 
menter closely observing trainee behavior. Trainees were not permitted to 
take their training materials with them from the classroom. All trainees 
were given a pretest the first day of class to determine prior knowledge of 
Morse code. Trainees having previously learned portions of the code were 
eliminated from the data analysis. Trainees were assigned to treatment 
groups on the basis of aptitude. A two-way split was made with the High 
aptitude group having a combined WK + AR score greater than 115 and the 
Average aptitude group having a combined WK + AR score of less than 115. 
The subjects falling in the Average category were of average intelligence 
when compared with recruits whose scores did not Jil^lify them for entry into 
the course. 
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PERFORMANCE PHASE. Prior to entry into class, trainees were administered a 
Visual Pattern Discrimination (VPD) test, and Visual Reaction Time (VRT) 
measures were taken. It was explained that these were related to the task of 
receiving code via flashing light later in the course and were being used to 
determine those persons requiring spesi-al assistance. 

The VPD test consisting of meaningless dots and dashes was group adminis- 
tered to each class to ensure standardization across groups. The flashing 
light signal was delivered by a time-punched tape which drove the light source. 
The short bursts of light could be identified as dots and dashes depending 
upon the duration of the light signal. The test consisted of 27 sets (in- 
cluding two practice sets) of randomized dots and dashes (six bits each set, 
the average length of a coded letter). The presentation rate was at five 
words per minute (the speed at which trainees are expected to read code at the 
end of 6 weeks). Trainees were instructed to repeat the pattern of dots and 
dashes on their answer sheets as they identified the patterns. Meaningful ness 
of the pattern was not an issue. 

Reaction time to a visual stimulus was taken prior to the beginning of 
classes. Trainees were instructed as to the purpose of the test and the 
relationship of the procedure to receiving code visually. The VRT apparatus 
was housed in two separate rooms and two experimenters were required. One 
experimenter instructed the trainee on the response mechanism, the other 
presented the stimuli. Stimulus presentation was randomized at 8 to 10 second 
intervals. The apparatus consisted of an energy source, a 15 watt bulb with a 
red glass plate covering, an experimenter button to trigger the light stimulus, 
a telegraph key for trainee response to the light stimulus, and a clock for 
measuring response time in 1/100 of a second. A series of 13 stimuli were 
administered to include three practice trials. For scoring purposes, the 
average of the 10 trials was used. 

DATA COLLECTION 

The instructor of each class introduced the trainees to code transmission 
via a flashing light during the second week of training. Video tapes were 
used to help trainees transition from "receiving" on paper to receiving via 
flashing light. Sight patterns (with brief bursts of light representing a 
series of dots and dashes) were presented at slow rates of speed. Each series 
represented a letter of the alphabet. Following the video tape exercises, the 
trainees practiced with a mechanically operated flashing light in the class- 
room. 

Each instructor gave the fourth and fifth week flashing light tests by 
using a tape-driven, mechanically operated apparatus. This apparatus ensured 
that all encoded messages were sent at five words per minute. Two specially 
made tapes, one for each week, ensured that all letters, numbers, and punctua- 
tion marks were given in the same manner to all classes (i.e., in 20 groups of 
5 characters per group--16 letter groups, 2 number groups, and 2 punctuation 
mark groups). The task was one of decoding; i.e., the trainee had to recognize 
that .- stood for A. The maximum possible score on each performance test was 
100. 
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The sixth week of training (the results of which are included in the 
regression analysis) was designed to familiarize trainees with a hand-operated, 
12-inch incandescent search light--the type used aboard ship to communicate. 
Trainees used this light to conmunicate among themselves while outside on 
simulated ship bridges. During this practical phase of training, instructors 
emphasized the development of good communication procedures. The sixth week 
examination was a combination of flashing light and flag semaphore code 
reception. 

ANALYSES 

An Analysis of Variance (ANOVA) was performed on the acquisition data to 
determine the effects of aptitude and type of instructional materials on 
learning to "send" and "receive" (paper and pencil test) Morse code. ANOVA 
source tables are included as appendix D. 

Performance data was first analyzed to determine whether there were any 
significant differences in performance due to treatment effects during the 
acquisition phase; then a step-wise multiple regression analysis was used to 
determine the degree to which the psychological predictor variables and the 
performance variables were interrelated and could be combined in a predictor 
model. A step-wise, rather than a canonical correlation, procedure was used 
since the study was of an experimental nature, and the step-wise procedure 
provided better capability for examining the impact of each variable. In 
multiple regression analysis, one dependent variable is partitioned from the 
rest of the matrix, while in canonical correlation analysis, two or more 
dependent variables are partitioned from the rest of the matrix. For purposes 
of this study, it was considered essential to determine the impact of each 
variable separately since strategies would be considered for each phase in the 
learning process based on trainee performance at each point in the cycle. 

The ANOVA was used to determine the differential effects of aptitude 
levels and amount of practice on flashing light performance (i.e., receiving 
messages at five words per minute). The Newman-Kuels procedure was used to 
determine the significance of the difference between means. To determine the 
strength of the association between treatment and scores obtained by the 
trainees in both the acquisition and performance phases of the course, eta 
squared was computed. This statistical data is discussed in appendix E. The 
study results follow. 
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SECTION n'l 
RESULTS 

This section reports the results of the data analyses. First, the 
results of the analysis of performance data for training weeks four and five 
are presented. Next, a description is given of trainee mean scores on the 
predictor (aptitude) variables followed by the intercorrelations of the predic- 
tor and criteria (performance) variables and the correlations between these 
variables. The results of the regression analysis are given in the form of 
regression coefficients for each best four-variable predictor model developed 
for each performance test (including week six) and Final School Grade (FS6). 
Regression equations were computed for each best four-variable predictor 
model. Expectancy tables have been developed from the raw data showing the 
relationship between the best four-variable models, the currently used two- 
variable model, and the criteria variables. The section concludes with a 
comparison of predictor variable scores for trainees who completed the course, 
those who were set-back, and those who failed to complete the course. 

The major emphasis of this study was on the performance phase of the 
signalman task. The acquisition data were obtained by Ainsworth (1979) and 
are summarized here for the purpose of clarity and convenience of the reader. 
More detail on code acquisition can be found in Ainsworth (1979), 

ACQUISITION PHASE 

The analysis showed that aptitude significantly affects learning to 
"send" paper and pencil test Morse code (£<.0001). Relevant statistical 
tables are provided in appendix D. When only aptitude was considered, High 
aptitude trainees performed significantly better than Average aptitude trainees. 
The type of instructional material also significantly affected learning to 
"send" Morse code (£<.0001). When aptitude was disregarded, trainees who 
studied with the two handbooks containing memory aids in the form of mnemonics 
performed better than those who studied without the memory aids. Trainees who 
used the handbooks containing guided learning and practice plus memory aids 
performed significantly better (£<.01) than trainees who used the traditional 
or guided learning and practice only materials. Trainees who used the guided 
learning and practice only handbooks performed significantly better than 
trainees who studied with traditional materials (£<.01). The amount of study 
time (2,4, and 6 hours) significantly affected the ability to "send" code 
(£<.0001); i.e., the mean scores for all experimental groups except Average 
aptitude, traditional materials, approached the limit of the test (42 points) 
after 4 hours of study. The mean score for all trainees at the end of 6 hours 
of study was 40.7. All treatment groups had essentially mastered the code 
after 6 hours of study. 

Aptitude significantly affected ability to learn to "receive" Morse code 
on paper (£<.0001). High aptitude trainees performed significantly better 
than Average aptitude trainees. Type of instructional material also affected 
learning to "receive" code (£< .0001). Trainees using the guided learning and 
practice plus memory aids performed significantly better (£<.01) than those 
using traditional materials. The amount of study time significantly affected 
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"receiving" ability {p<.0001 ). The mean scores of all groups approached the 
limit of the test (42) after 6 hours of study. 

PERFORMANCE PHASE 

The results showed that academic ability (as measured by the WK and AR 
ASVAB subtests) significantly affects the ability to receive flashing light 
messages. High aptitude trainees performed significantly better than Average 
aptitude trainees {£<.001). Type of instructional material used during 
acquisition did not significantly affect the reception of Morse code via 
flashing light. There were no significant differences in trainee performance 
across treatment groups. As expected, flashing light test scores improved 
from one week of training to the next. The basic performance data are 
depicted in figure 1. 

CORRELATIONS BETWEEN VARIABLES 

The major emphasis of this study phase was on the relationship of 
predictor (aptitude) variables to (1) accuracy of signalman trainees in 
receiving Morse code visually and (2) FSG. The predictor variables included 
trainee scores on subtests of the ASVAB, WK, AR, Attention to Detail (AD), 
Mechanical Comprehension (MC) subtests. Education (ED), Age, VPD, and VRT. 
The criteria variables were three flashing light performance tests (PL 1, 2, 
and 3) and FSG. The third examination combines reception of code via flash- 
ing light and semaphore flag learning. It was added to the criteria variables 
at this point in the study to provide a more complete picture of the total 
performance task. The mean, standard deviations, and range of the predictor 
variables are provided in table 1. 



TABLE 1. MEAN, STANDARD DEVIATION, AND RANGE OF TRAINEE 
SCORES ON PREDICTOR VARIABLES 



Variable 


Mean 


Standard 
Deviation 


Range 


Word Knowledge 


60.06 


7.08 


44-74 


Arithmetical Reasoning 


55.80 


6.10 


37-70 


Attention to Detail 


52.88 


8.75 


30-70 


Mechanical 


50.99 


7.98 


31-73 


Education 


11.81 


1.33 


9-16 


Age 


20.80 


2.58 


17-30 


VPD 


10.40 


3.50 


02-20 


Visual Reaction Time 
(lOOths of a second) 


25.63 


3.43 


20-54 
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Figure 1. Performance Curves for Two-Aptitude/Four-Treatment 
Groups on Flashing Light Tests 
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The mean ASVAB scores of the total trainee group all fell above the mean 
(50) indicating that the population was of average or above average intelli- 
gence. The mean score on the VPD test was 10 (out of a possible 25), with a 
range of 2-20. The mean VRT score was .26 seconds, ranging from .20-. 54 
seconds. 

The intercorrelations between the predictor and criteria variables are 
presented in table 2. The majority of the correlations obtained were signifi- 
cant at the .01 level; those which were not have been underlined. 

PREDICTOR INTERCORRtLATIONS 

The ASVAB WK scores were correlated significantly and positively with 
other predictor variables except for VRT and Age. Visual Reaction Time 
correlated negatively and nonsignificantly while Age correlated negatively 
and significantly. This indicates some degree of commonality; i.e., the WK 
test measures some of the same factors measured by the other predictor 
instruments. 

Like WK, AR was positively and significantly correlated with the majority 
of the predictor variables. The two exceptions were VRT and Age which were 
negative and insignificant. Attention to Detail was positively and signifi- 
cantly correlated with WK and AR, .31 and .20, respectively. There were no 
other significant correlations. The correlations indicate some commonality of 
factors between the AD subtest and the WK and AR tests. The highest cor- 
relation obtained for MC was with AR (.43). Mechanical Comprehension was 
iToderately, but significantly, correlated with WK (.24), VPD (.27), and VRT 
(-.15). 

Visual Pattern Discrimination was positively and significantly correlated 
with MC (.27), WK (.23), and AR (.18) again, indicating some commonality 
betvseen these measures. Visual Reaction Time apparently measures a factor not 
measured by the other predictor tests. Visual Reaction Time was positively 
correlated with MC (.16) which was no surprise. No other significant cor- 
relations were obtained for VRT. 

CRITERIA INTERCORRELATIONS 

Intercorrelations between the three flashing light tests were high and 
positive; those between flashing light tests 1 and 2 and "send'* (S3) and 
"receive" (R3) paper and pencil tests were moderate, but significant. No 
significant correlation existed for FL3 and the final "send" and "receive" 
tests. Apparently, factors other than Morse code knowledge weigh heavily in 
that test--semaphore code, for example. 

Final School Grade correlations were highly significant with the three 
flashing light tests, the highest (.65) with FLl . This indicated that these 
tests measure a source of variance which makes up a significant part of the 
variance in the final grade; therefore, any variable which can predict flashing 
light performance early in the course would be an asset to the instructor for 
applying training strategies. Final School Grade was correlated moderately 
and positively with the final acquisition "send" and "receive" scores, .35 and 
.49, respectively. 
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TABLE 2. CORRELATION COEFFICIENTS OF PREDICTOR AND CRITERIA VARIABLES 





UK 


AR 


AD 


HC 


ED 


Age 


VPD 


VRT 


FLl 


FL2 


FL3 


FSG 


S3* 


R3* 


UK 


1.00 












• 
















AR 


.26 


1.00 


























AD 


.31 


.30 


1.00 

1 • VV 
























HC 


.24 


.43 


.11 


1.00 






















ED 


.47 


.22 


.11 


.13 


1,00 




















Age 


-.38 


-.03 




.12 


-.48 

f TW 


1.00 

1 f VV 


















VPD 


.23 


.18 


.07 


.27 


.13 


.04 


1.00 
















VRT 


-.03 


-.10 


-.12 


-.16 


.05 

1 WW 


.02 


.02 


1 00 

1 f Vv 














FLl 


,30 


.31 


,26 


.16 


.17 


.01 

1 W 1 


.24 


-.10 


1 00 












FL2 


.24 


.30 


.27 


.19 


.03 


.04 


.27 


-.16 


.66 


1.00 










FL3 


,28 


.31 


.18 


.30 


.14 


-.00 


.07 


-.21 


.49 


.53 


1.00 








FSG 


.54 


.54 


.33 


.36 


.41 


.09 


.28 


-.10 


,65 


.52 


,46 


1.00 






S3* 


.24 


.18 


.15 


,17 


•U 


.05 


.07 


-.06 


.18 


.21 


.02 


.35 


100 




R3* 


. .30 


.30 


.20 


.19 




-.01 


•li 


-.14 


.25 


.26 


•]1 


.49 


.80 


1.00 



*Sen(l, receive, paper and pencil tests 
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CORRELATIONS BETWEEN PREDICTOR AND CRITERIA VARIABLES 

Correlations between the ASVAB WK, AR, AD, and MC variables and performance 
flashing light test scores were positive and significant as were those between 
the ASVAB tests and the final "send" and "receive" test scores. For prediction 
purposes, this indicated that trainees who do well on the predictor tests 
should succeed in the course. It further indicated that the cognitive factors 
measured by the WK, AR subtests weigh heavily in the ability to receive code 
via flashing light. The AD subtest measures attention to detail. The moderate, 
positive correlation with flashing light tests indicates that the same close 
attention which is required in clerical procedures is important in receiving 
code visually. This, in essence, is a measure of the attentive processes 
identified by information processing theorists. 

Visual Pattern Discrimination was correlated significantly with scores on 
flashing light tes*;s 1 and 2, but not correlated with FL3. This indicated 
that some factor other than the spatial factor measured by VPD was included in 
the FL3 test score. The test consisted of receiving code via flashing light 
with a hand operated flashing light in a simulated shipboard environment and 
receiving code via semaphore flags. 

Visual Reaction Time was significantly and negatively correlated with FL2 
and FL3 and the final "receive" test scores. The negative correlation indicated 
that trainees who have a faster reaction time are better in receiving flashing 
light messages. Each of the criteria tests was timed and this could account 
in part for the relationship of VRT and the criteria tests. 

Final School Grades were significantly correlated with all predictor 
variables except VRT and Age. WK and AR had the highest correlation with FSG, 
.54 in each instance. This indicated that the cognitive factors measured by 
these subtests weigh heavily in the final grade composite. 

PREDICTION OF PERFORMANCE AND FINAL SCHOOL GRADE BY REGRESSION ANALYSIS 

Predictor models were developed using the step-wise multiple regression 
procedure. The best four- variable model obtained for performance and FSG for 
the total sample is presented here for comparison purposes along with the two- 
variable model currently in use. A separate regression procedure was used to 
develop predictor models for the bottom one-quarter of the trainees based on 
aptitude. These models are also presented. The variables' multiple R values 
were generated as part of the step-wise multiple regression procedure. 

FLASHING LIGHT TEST NO. 1. Table 3 shows the standard error regression 
coefficients and percent variance accounted for by each of the variables in 
the best four- variable model for performance test FLl for the total sample. 
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TABLE 3. REGRESSION COEFFICIENTS OF THE FOUR-VARIABLE 
MODEL PERFORMANCE FLASHING LIGHT TEST (FLl)* 



Variable 


Standard Error 


Beta 
Coefficients 


% Variance 
Accounted for 


WK 


0.578 


0.456 


9.1 


AR 


0.587 


0.460 


4.7 


VPD 


3.172 


0.454 


1.9 


AGE 


1.524 


0.524 


1.1 






TOTAL 


16.8 



Yp- intercept = -8.94 
R*^ = .178 
R = .421 

♦Significance level for model entry £ =< .10 



The multiple regression equation for FLl based on the best four-variable 
model is: 



FLl = 0.46 (WK) + 0.46 (AR) + 0.45 (VPD) 
+ 0.52 (AGE) - 8.94 

By comparison, using FLl data for the two-variable model currently in 
use, WK was found to account for 9 percent and AR for 6 percent, for a total 
of 15 percent. 

FLASHING LIGHT TEST NO. 2. Table 4 shows the standard error, regression 
coefficients, and percent variance accounted for by each of the variables in 
the best four-variable model for performance test FL2. 
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TABLE 4. REGRESSION COEFFF OF THE FOUR-VARIABLE MODEL 

PERFORMANCE FLASI- 3HT TEST (FL2)* 



Variable 


Standard Err 


Beta 
Coefficients 


% Variance 
Accounted for 


WK 


0.133 


0.430 


8.3 


AR 


0.137 


0.389 


5.4 


VPD 


0.239 


0.533 


3.0 


ED 


0.691 


-1.500 


2.9 






TOTAL 


19.6 



Yp- intercept = 50.17 
R = .195 
R = .442 

♦Significance level for model entry £ =<.10 



The multiple regression equation for FL2 based on the best four-variable 
model is: 

FL2 = 0.43 (WK) + 0.39 (AR) + 0.53 (VPD) 
- 1.50 (ED) + 50.17 

By comparison, using FL2 data for the two-variable model, WK was found to 
account for 8 percent and AR for 5 percent, for a total of 13 percent. 

FLASHING LIGHT TEST NO. 3. Table 5 shows the standard error regression 
coefficients and percent variance accounted for by each of the variables in 
the best four-variable model for performance test FL3. 
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TABLE 5. REGRESSION COEFFICIENTS OF THE FOUR-VARIABLE MODEL 
PERFORMANCE FLASHING LIGHT TEST (FL3)* 



Variable 


Standard Error 


Beta 
Coefficients 


% Variance 
Accounted for 


WK 


0.106 


0.220 


10.7 


MC 


0.104 


0.174 


4.9 


AR 


0.134 


0.318 


3.8 


VRT 


0.207 


-0.413 


3.2 








TOTAL 22.6 



Yp- Intercept = 58.63 
R^ = .193 
R = .440 

*Significance level for model entry £=<. 10 



The multiple regression equation for FL3 based on the best four-variable 
model is: 

FL3 = .22 (WK) + .17 (MC) + .32 (AR) 
- .41 (VRT) + 58.63 

By comparison, using FL3 data for the two-variable model, AR was found to 
account for 11 percent and WK for 4 percent, for a total 15 percent of the 
variance. 

FINAL SCHOOL GRADE. Table 6 shows the standard error, regression coefficients, 
and percent variance accounted for by each of the variables in the best four- 
variable model for FSG. 
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TABLE 6. REGRESSION COEFFICIENTS OF THE FOUR-VARIABLE 
MODEL FINAL SCHOOL GRADE (FSG)* 



Variable 


Standard Error 


Beta 
Coefficients 


% Varianrp 
Accounted for 


WK 


0.578 


3.528 


29.6 


AR 


0.587 


3.392 


15.7 


ED 


3.172 


9.413 


3.4 


AGE 


1.524 


4.686 


1.7 








TOTAL 50.4 



Y«- Intercept = 107.18 
R = .503 
R= .709 

*Significance level for model entry £ =<.10 



The multiple regression equation for FSG based on the above four-variable 
model is: 

FSG = 3.53 (WK) + 3.39 (AR) + 9.41 (ED) 
+ 4.69 (AGE) + 107.18 

PREDICTION OF PERFORMANCE AND FINAL SCHOOL GRADE FOR BOTTOM ONE-FOURTH APTITUDE 
GROUP 

A continuing problem is the optimization of training for marginal, low- 
aptitude personnel. While none of the individuals in this study were marginal, 
it was expected that an analysis of the performance of individuals in the 
lowest quarter of the aptitude scale would produce valuable information. 
Improved methods for the selection and training of these individuals would 
make it possible to utilize individuals not presently considered for this 
course. 

For the total sample (high and average aptitude groups combined), the 
ASVAB, WK, and AR accounted for the major portion of the variance. However, 
these test scores were not sufficiently significant to enter the four-variable 
model for the lower aptitude group. Visual Pattern Discrimination accounted 
for the major portion of the variance for this group of trainees for both 
initial performance and FSG. 

Table 7 shows the standard error regression coefficients and percent 
variance accounted for by each variable in the best four-variable model for 
the first flashing light performance test for the bottom quarter of the sample 
based on combined WK + AR scores. 
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TABLE 7. REGRESSION COEFFICIENTS OF THE FOUR-VARIABLE MODEL PERFORMANCE 
TEST (FLl) FOR BOTTOM 25 PERCENT, COMBINED WK + AR SCORES* 



Variable 


Standard Error 


Beta 
LUcTT I CI en ts 


% Variance 
Accounted for 


VrU 


0. 759 


1 .243 


4.5 


AD 


0.324 


0.367 


2.5 


MC 


0.222 


0.218 


2.5 


AGE 


0.802 


0.785 


2.8 






TOTAL 


12.3 



Yp- Intercept = 18.93 
R^ = .121 
R = .348 



♦Significance level for model entry £=<. 10 

Using the FLl data for the lowest quarter aptitude group, VPD was found 
to account for 5 percent of the total variance, AD for 2 percent, MC for 2 
percent, and Age for 3 percent, for a total of 12 percent. 

The multiple regression equation for FLl based on the best four- 
variable model is: 

FLl = 1.24 (VPD) + .37 (AD) + .22 (MC) 
+ .78 (AGE) + 18.93 

Table 8 shows the standard error regression coefficients and percent 
variance accounted for by each variable in the best four-variable model for 
FSG for the bottom quarter of the sample (based on combined WK + AR scores). 
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TABLE 8. REGRESSION COEFFICIENTS OF THE FOUR-VARIBLE MODEL, FINAL 

SCHOOL GRADE FOR BOTTOM 25 PERCENT, COMBINED WK + AR SCORES* 



Variable 


Standard Error 


Beta 
Coefficients 


% Variance 
Accounted for 


VPD 


2.319 


3.948 


12.9 


AD 


0.798 


0.916 


10.3 


ED 


7.396 


16.649 


6.2 


AGE 


2.667 


6.953 


2.9 








TOTAL 32.3 



Yp- Intercept = 154.19 
R^ = .321 
R = .567 

♦Significance level for model entry £ = < .10 



Using the FSG data for the lowest quarter aptitude group, VPD was found 
to account for 13 percent of the total variance, AD for 10 percent, ED for 6 
percent, and Age for 3 percent, for a total of 32 percent. 

The multiple regression equation for FSG based on the best four-variable 
model is: 

FSG = 3.95 (VPD) + .92 (AD) + 16.65 (ED) 
+ 6.95 (AGE) + 154.20 

It should be noted for performance FLl that for the total sample WK and 
AR accounted for the major portion of the variance (14 percent) followed by 
VPD and Age (3 percent); whereas, for the lowest quarter aptitude group, VPD 
and AD accounted for the major portion of the variance (7 percent) followed by 
MC and Age (5 percent). No other variables entered the model at the .10 level 
of significance. For FSG for the lowest aptitude group, VPD and AD accounted 
for the major portion of the variance (23 percent) followed by ED and Age (9 
percent); while, for the total sample, WK and AR accounted for the major 
portion of the variance (45 percent) followed by ED and Age (5 percent). 
VPD appears to be a better predictor of performance and FSG for lower aptitude 
persons than the ASVAB WK and AR subtests. 

ESTIMATE OF SHRINKAGE FOR MULTIPLE CORRELATIONS 

The sample of trainees employed in this study was a preselected group 
based on previously administered ASVAB scores. One would expect the R in 
the second sample to be smaller because of sampling error. To obtain an 
unbiased estimate of predictor validity for future samples (i.e., selected 
from the total available population), a cross-validation procedure was employed. 
The sample population was split into two subsamples containing approximately 
two-thirds and one-third of the total sample. This was done by random selection 
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of 7 and 13 from each cell of 20. Regression equations were computed for each 
of the "best" four-variable models predicting FLl , 2, and 3 and FSG. The 
regression equations computed using the two-thirds subsample were used to 
predict scores on a holdout group. The predicted scores were then correlated 
with actual scores obtained by individuals in the one- third holdout group. 
The correlations were: .43 for FLl, .38 for FL2, .29 for FL3, and .36 for 
FSG. In comparison, the correlations for the total group were .42 for FLl, 
.44 for FL2, .44 for FL3, and .70 for FSG. Each of the cross-validation 
correlations was significant at greater than the .01 level indicating that the 
predictive data can be applied to the general Navy signalman population with a 
reasonable degree of confidence. 

RELATIONSHIP OF PREDICTOR AND CRITERIA VARIABLES-EXPECTANCY TABLES 

Expectancy charts were developed from the raw data; i.e., the "regular" 
method described in Guilford (1956) to show relationships between the predictor 
and criteria variables. The criterion for passing the flashing light tests is 
80 percent. 

FLASHING LIGHT TEST NO. 1. Figure 2 is an expectancy chart showing the per- 
centage of trainees who were successful in achieving the performance (FLl) 
criterion at each level of the combined ASVAB (WK + AR) scores. It will be 
noted that of the 23 trainees with ASVAB scores below the cutoff point for 
entry into the course, 78 percent failed to achieve the 80 percent necessary 
to pass the test. 

Figure 3 is an expectancy chart showing the percent of trainees who could 
be expected to receive a passing score (80 percent) on performance test FLl at 
each level of predictor scores. The best four-variable model (combined WK + 
AR + VPD + Age) was used to derive percent of successful trainees at each 
aptitude level. Ninety- two percent of the trainees selected will achieve a 
passing score if trainees having a combined score of 150 and above on the 
predictor criteria are selected. 

FLASHING LIGHT TEST NO. 2. Figure 4 is an expectancy chart showing the 
percentage of trainees who were successful in achieving the 80 percent crite- 
rion (FLl) for each level of the ASVAB (WK + AR) scores. Note that 43 per- 
cent of those with scores below the selection cutoff score (105) failed to 
meet the criterion. 

Figure 5 is an expectancy chart showing the relationship between trainee 
scores on the best four-variable model and performance (FL2) scores. Indivi- 
duals having a combined score of 110 or above can be expected to attain the 
course criterion level of 80 percent. 

FINAL SCHOOL GRADE. The criterion level for passing the course is an FSG of 75 
percent. Data were analyzed to determine the relationship of FSG to the 
derived four-variable model (WK + AR + ED + Age) and the presently used two- 
variable model (WK + AR) . Expectancy charts were developed and are shown in 
figures 6 and 7. Figure 6 shows that, based on the current two-variable 
model, 4 percent (one trainee) of those who remained in the course up to 
graduation failed; however, 96 percent of those who were predicted to fail 
actually achieved the criterion of 75 percent for passing the course. Figure 
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7 shows the mean FSG expected for trainees categorized according to combined 
predictor scores (four-variable model). 

COMPARISON OF ATTRITES AND NON-ATTRITES 

To better understand course attrition factors, data were analyzed to 
compare trainees who completed the course with those who were set back to 
repeat phases of the course and those who failed to complete the course. Only 
those who completed the course were included in the analysis of main instruc- 
tional effects; i.e., 160 trainees. 

The passing FSG for the course is 75 percent. The number of possible 
total points is 1,000. The minimum ASVAB combination for entry into the 
course is 105. Depending upon the needs of the Navy, trainees may receive 
waivers to enter the course. Of the 180 trainees in the total sample, 30 had 
ASVAB WK + AR scores below the 105 cutoff score. Of these 30 trainees, 27 
percent failed to complete the course. Of those trainees with ASVAB scores 
between 105 and 120, 13 percent failed to complete the course. Table 9 shows 
a comparison of means for the three groups on the predictor variables. The 
three groups did not significantly differ from each other although the set- 
backs and attrites tended to have slightly lower scores on the predictor 
variables. Of the total population of 180 trainees, 12 percent (26) were set 
back to repeat one or more phases of the course, and 11 percent (20) failed to 
complete the course. Figure 8 shows the relationship between ASVAB (WK + AR) 
scores and failure to complete the course. 



TABLE 9. COMPARISON OF MEANS FOR THREE GROUPS OF 
TRAINEES ON PREDICTOR VARIABLES 





No Attrite 
Group (N=160) 


Setback 
Group (N=26) 


Attri te 
Group (N=20) 


WK 


60.07 


57.38 


56.80 


AR 


55.80 


55.73 


52.20 


AD 


52.88 


50.35 


49.60 


MC 


50.98 


50.65 


49.66 


ED 


11.81 


11 .12 


11.13 


AGE 


21.17 


20.12 


20.40 


VPD 


10.40 


8.79 


9.89 


VRT 


25.63 


27.03 


25.20 


(N.S. £<.0l) 




30 

26 
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Figure 2. Expectancy Chart Showing Relationship Between Score 
Made on ASVAB (WK+AR) and Performance (FLl) 
for Signalman Trainees 
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SECTION IV 
DISCUSSION 

The following discussion is in three parts. First, the validation of 
the ASVAB subtests currently used in the selection of signalman trainees and 
the individual characteristics which appear to be related to receiving Morse 
code visually are discussed. This is followed by a discussion of the attrition 
data gathered during the study. Finally, a model 1s proposed for use in the 
signalman course which could be expected to facilitate the learning and 
practice of communication via Morse code. 

VALIDATION 



, A concurrent validation of the ASVAB WK and AR subtests as predictors of 
signalman success was accomplished. The ASVAB subtests WK and AR correlated 
with FSG .544 and .535, respectively, and .67 in combination. While a corre- 
c^.^n?o nl respectable, it may have been greater in a random 

sample of the total Navy population. The best predictors of course success 
were the ASVAB subtests WK and AR followed by VPD and VRT. The results 
indicated that the WK and AR subtests currently used for assigning trainees 
A/^o 1 signalman course are good predictors of both performance and FSG. 
Visual Pattern Discrimination and VRT were not as strong as anticipated for 
predictive purposes for the total group. Evidently, the signalman task is 
most heavily influenced by cognitive factors. 

While VPD and VRT did not contribute enough to the variance to be 
generally practical as predictors for course selection, the addition of VPD 
to the model would provide a finer discrimination if and when selection 
ratios eventually permit the use of a more discriminating selection instrument. 

rnHP t^^k "?hI"f,DS"%""i^ "'^''^ regarding the nature of the signalman Morse 
code task. The VPD. for the most part, samples the ability to perceive the 
facJSr''^?hi ^dft^fyjhe length of exposure (dot-dashj; i.e\, a spatill 
factor. The VPD entered the four-variable model for FLl, and FLl scores were 
PnZ'i''^^ significantly with FSG. While VPD did not account for a llrge 
enough share of the variance for the total sample to be practical as a 
predictor of course success, apparently it can provide an early indication of 
fin ^/li^ experience some difficulty in the performance phase. It could 
be used at the school level to identify potential failures and identify those 
individuals requiring special assistance: laeniiry tnose 

Visual Pattern Discrimination turned out to be the best predictor for 
performance and FSG for the bottom aptitude quarter of the sample The 
ic of^^?.'" training of individuals at the low end of the aptitude continuum 
IS of major concern for the military. As the population of 18 year olds 
decreases, the requirement to utilize more marginal, low-aptitude personnel 
increases. Past experience has shown that a number of these individuals will 
be successful but, to date, no selection instruments have successfully predicted 
which ones. The VPD test appears to be sufficiently sensitive for detefiJfn ng 
^p^pot nnTT^^.'^i'*"^^ individuals can succeed at the signalman visual 
reception task. Used as a pretest. VPD could identify individuals requiring 
additional assistance, and it may even be useful as a training tool early in 
the course to acquaint the trainee with follow-on training 
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Visual Reaction Time entered the four-variable model for FL3 as a signi- 
ficant contribution. Apparently, as trainees reach maximum performance 
level; i.e., are knowledgeable in the code, the ability to react quickly is a 
factor in the speed of receiving code. Visual Reaction Time, then, is a 
predictor of speed and accuracy in visual reception of Morse code. Again, 
for practical purposes, VRT does not contribute sufficiently to the variance 
to warrant use in the selection battery as a predictor of course success. 
The simple VRT test as conducted in this study was probably not difficult 
enough to get at the complexity of the total information processing task. A 
choice VRT test probably would have better served the purpose of prediction. 
However, the experimenter was looking for a relatively simple procedure for 
the school staff to use as an indication of possible difficulties which might 
be encountered by the trainee later in the course. 

An unexpected result was the relationship of Age to FS6. The age range 
was 1 7 to 30 years, and the older trainees received better grades These 
were career individuals who had returned to school for cross-training in 
another occupation; .rtey may have been better motivated than younger, newly 
enlisted individuals. ^ » » j 

Years of formal schooling was positively correlated with FSG. Whatever 
factor determines an individual's ability to remain in a formal educational 
setting significantly affects his ability to profit from training. This 
could be simply "stick- to-itivity" in some cases and aptitude in others. 
Higher aptitude individuals tend to find formal schooling rewarding and are 
apt to profit from the same and continue longer, while many with lesser 
ability stay in the school setting despite the fact that their grades are 
less than adequate. For the total sample, it is interesting that while VPD 
and VRT entered into the predictor models for the three performance tests, 
neither achieved the .10 significance level required to enter the model for 
hbb. Apparently, the final grade is more heavily weighted toward the cognitive, 
academic factors than is the flashing light performance grade. Visual Pattern 
Discrimination, however, turned out to be a better predictor of FSG for the 
bottom one- fourth aptitude group than the ASVAB scores, justifying somewhat 
the concern expressed by instructors that the ASVAB does not accurately 
predict performance for all trainees. 

The major reason for trainee difficulties iL likely a failure to place 
enough emphasis on the performance training phases for the lower aptitude 
individuals. In this study, trainees had mastered the Morse code prior to 
the performance phase. Nevertheless, there were significant differences in 
scores obtained by High and Average trainees on the visual code receiving 
task. There are several possible explanations for this. Practice strengthens 
the memory trace for information stored in memory. Perhaps the lower aptitude 
individual requires more rehearsal to strengthen the memory trace; i.e , 
practice time may have been insufficient for permanent storage of the informa- 
tion in memory. Another possible explanation is that lower aptitude individuals 
require more time to retrieve the information from memory at time of decoding, 
five words per minute may have been too fast at this stage in their learning! 
At any rate, from the data obtained, information processing for signalmen 
appears to be more related to cognitive than to perceptual factors (once 
minimal perceptual requirements; e.g., light intensity, are met) 
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The data analysis indicated that the addition of the VPD and VRT variables 
to the currently used two-variable ASVAB model would be useful for predictive 
purposes. While the difference between the multiple correlations for the 
two- and four-variable models for FLl w'as not statistically significant, the 
differences between the two- and four- /ari able models for FL2 and 3 were 
significant as was the difference between the two- and four-variable models 



IT 1°"^ *5 I^^ restricted sample employed in this study, traditional methods 
(Taylor and Russell (1939), Naylor and Shine (1965) in Zedeck (1974), p 127) 
were precluded from use in estimating predictive efficiency. Hence, expectancy 
tables were based on raw data. For two performance grades and FSG, the 
multiple correlations obtained for the four-variable models were significantly 
different (P =< .01) from those obtained for the two-variable WK + AR models. 
If, 1.^ the future, it should be decided that a finer discrimination is desir- 

t^fVrJ J;SJoP-''P°'"'.*^^ !!^° ""^y adding to the selection 

l^.' a 9°°^^ predictor of success in the signalman course; 

TlZZl r!'^^^l ""^y high since the majority of those 

trainees predicted to fail did indeed pass the course. That is, it may be 

f?";Di^ °^ ^"P"* *° t^ie course through (1) the use of 

t VPD test for Identifying problem trainees and (2) longer practice periods 
sser qualified individuals. 

INDIVIDUAL CHARACTERISTICS RELATED TO RECEIVING MORSE CODE VIA FLASHING LIGHT 

The ASVAB subtest scores were correlated with flashing light performance. 
uJ^LUj'n 7 r'''*^? correlations of .30, .24, and .28 were obtained between 
WK ana FLl, 2, and 3. Significant positive correlations of .31, .30, and 31 
were obtained between AR and FLl, 2, and 3. This indicated that the cognitive 
knowledge and reasoning ability measured by these subtests were important 
factors in learning and performing the signalman task. Visual Pattern 
Discrimination correlated significantly, .24 and .27, with FLl and 2 indicating 
that the spatial factor measured by this test was a significant factor in 
receiving code visually. Significant correlations were obtained for VRT with 

•Zu i -.16 and -.21. The significant negative correlations for VRT 
with performance indicated that there was a significant relationship between 
an individual's reaction time and his ability to receive flashing light 
messages; that is, the quicker the reaction time, the better the receivinq 
score. ^ 



It was expected that WK and AR would be significantly correlated with 
learning the code and that the VPD and VRT measures would be significantly 
correlated with performance. As expected, for the total group, WK and AR 
were significantly correlated with learning the code. They were also good 
predictors of ability to receive flashing light messages, having accounted 
for the major proportion of the variance. Visual Pattern Discrimination 
u« H and VRT were also correlated with receiving flashing light messages. 
Word Knowledge and AR proved to be the best predictors of FLl, followed by 
VPD and Age. This indicated that the cognitive factors measured by WK and AR 
outweigh the spatial and reaction time factors inherent in receiving flashing 
light messages. However, the VPD and VRT do measure some abilities required 
for the task which are not conmon to the WK and AR subtests. For FL2, WK and 
AR proved to oe the best predictors followed by VPD and Education. For FL3, 
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MC and AR proved to be the best predictors followed by VRT and WK. The 
correlation of MC with FL3 scores may be due, in part, to the fact that 
sending messages by semaphore flag was included in the sixth week test score; 
however, the correlation of VRT with FL3 may mean that reception speed, and 
hence reaction time, becomes more important in the later weeks of training 
when factors other than code knowledge become important. 

Significant correlations (.23 and .18) were obtained between VPD and WK 
and AR, respectively, indicating some overlapping or commonality of factors 
measured by these instruments. Correlations between VRT and WK and AR were 
not significant, indicating that VRT measures a factor or factors not measured 
by these subtests. Final "send" and "receive" (paper and pencil) test scores 
were correlated with performance scores reflecting that those who did well in 
the acquisition phase tended to do well in the performance phase of the 
course. Significant correlations were obtained between "send" (.18 and .21) 
and "receive" (.25 and .26) and FLl and 2, respectively. These scores did 
not correlate significantly with FL3 probably because other components, 
including the ability to send messages via semaphore flags, are included in 
these test scores. 

The correlations obtained indicate that VPD and VRT are indeed related 
to the ability to receive flashing light messages and measure factors other 
than those measured by the WK and AR subtests. The correlations obtained for 
the predictor variables WK, AR, VPD, and VRT with the criteria variables 
indicate that cognitive and reasoning ability and pattern discrimination and 
quick reaction time are all requirements for success in accomplishing the 
signalman information processing task. Furthermore, individuals who are 
successful in the public educational system stand a good chance of succeeding 
at the signalman task. Interestingly, VPD ability apparently compensates to 
some extent ^or cognitive ability, as reflected by the ASVAB subtests, since 
this test accounted for the major portion of the variance in performance and 
FSG for the one- fourth of the trainees having the lowest WK + AR aptitude 
scores. 

ATTRITION 

Of the total experimental population (180 trainees), 11 percent failed 
to complete the course. The majority of these were dropped from the course 
within the first 3 weeks. 

There were no significant differences in ability between those who 
attrited and those who successfully completed the course. One could infer 
that reasons other than aptitude account for trainees' failure. It is probably 
safe to assume that these reasons are personal and motivational in nature. 

TRAINING STRATEGIES 

Although all graudates achieved graduation performance criteria the train- 
ing program does not eliminate differences between High and Average aptitude 
trainees. However, lower aptitude individuals can be brought to mastery 
level for skills of similar difficulty to the one trained in this study by 
adapting training methods to aptitude level (Mew and Muller, 1972). One of 
the expected study outcomes was the matching of psychological variables to 
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particular learning strategies. Whether a student's own learning (cognitive) 
style is matched or mismatched to a teaching strategy can have a considerable 
effect on learning and performance (Pask, 1976). 

The innovative cognitive strategies employed in learning the code were 
guided learning and practice and mnemonics. It can be inferred that the use 
of mnemonics facilitates the learning of Morse code, and that the addition of 
structure provided a unique contribution which further aided the learning 
process. Average aptitude individuals learned more quickly and achieved 
scores equal to High aptitude individuals using traditional study methods 
when these strategies were employed. 

The results corroborate those of Mew and Muller (1972). In that study. 
Low aptitude auto mechanic trainees achieved scores equivalent to High aptitude 
trainees when learning was structured in procedural steps. Low aptitude 
trainees required slightly longer to reach criterion, however, not as long as 
they did using traditional training strategies. The assumption can be made 
from the results obtained in this study and that of Ainsworth (1979) that 
cognitive strategies can compensate for low capacity, although these individuals 
u^^^^i^J^ ^^^^ *° comprehend subject matter as complex as that compre- 

hended by those of high capacity. Another assumption can be made in view of 
the study results that strategies appropriate for less bright individuals 
might not be appropriate for bright individuals who are probably better able 
to develop their own strategies. For example, too much structure may "inhibit 
brighter trainees who have developed their own learning techniques. The 
introduction of strategies used in these studies to the signalman course 
would assist trainees in acquiring, retaining, and retrieving information. 
More effective training strategies may make it possible to utilize individuals 
who would not be admitted to the course as it is presently conducted. Figure 
9 Illustrates a model which is proposed to improve the training offered for 
signalmen. The model provides bridges; i.e., provides a way of organizing 
the learning situation. The instructional strategies evolve around the 
following essential elements: 

• mnemonics 

• structured learning and practice 

• individually-paced instruction 

• orienting tasks. 

The learning package incorporating guided learning and practice and 
mnemonics was found to be most suited for acquisition of code for mixed 
groups and is a suitable cognitive strategy for the course. To aid in learn- 
ing to receive code via flashing light, trainees would be introduced early in 
the course to the visual reception of code through the use of an "orienting 
task" (Visual Pattern Discrimination). The term "orienting task" is used to 
designate a method for inducing the trainee to perform particular kinds of 
operations; i.e., providing cues which may be in the form of questions, 
verbal commands, or visual stimuli. 
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The end result of signalman instruction is the mastery of the ability to 
send and receive messages visually via Morse code. That Visual Pattern Dis- 
crimination is a difficult task which must be learned is indicated by the 
average score obtained (10.40, range 2-20 out of a possible 25 points) on the 
VPD pretest. The inclusion of this "orienting task" early in the course to 
alert trainees to the expected task should improve later performance. 

Not all instructional strategies are designed to induce students to use 
cognitive strategies. They may instead be concerned with optimal allocation 
of trials or of time for learning the content and practicing the skill. The 
data obtained in this study indicate that while Average aptitude individuals 
attained scores equivalent to High aptitude individuals in the initial learn- 
ing phase, they did not perform as well in visual code reception. While 
several factors could account for this, for all practical purposes, it can be 
assumed that "time to rehearse" was insufficient for these trainees. Lower 
aptitude individuals require more time to learn tg criterion and more practice 
time to master code reception. Therefore, the instructional design should 
include sufficient time for these individuals to master the task. At the 
same time. High aptitude individuals could be accelerated. Because of indivi- 
dual differences in acquisition, retention, and retrieval skills and process- 
ing capacity, each trainee would start at a different place and progress at a 
different rate. Because of the interrelationships and interactions of the 
elements in the instructional sequence, and of individual differences among 
trainees, procedures for control over outcomes of instruction should be 
sensitive to these complexities. 
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SECTION V 

CONCLUSIONS AND RECOMMENDATIONS 

This section contains the major conclusions derived from the study and 
proposes recommendations for improving the signalman course. 

CONCLUSIONS 

• Mnemonics and guided learning and practice were significant factors 
in facilitating the acquisition of Morse code. 

• The innovative training strategies proved more effective for 
Average than for High aptitude trainees. 

• The type of training materials used for code acquisition had no 
significant effect on performance (receiving code visually via 
flashing light). 

. The signalman course, as conducted during this study, did not 
appear to minimize differences in performance across aptitude 
groups; i.e., while trainees met the minimum requirements for 
graduation, the training program did not maximize performance 
for the average aptitude trainee. 

• Visual Pattern Discrimination ability is a significant factor in 
receiving Morse code via flashing light. 

• The VPD test was better at predicting subsequent grades for low- 
Average aptitude individuals than for High aptitude individuals. 

• The ASVAB, WK, and AR subtests were good predictors of code acquisi- 
tion and performance for High aptitude individuals. 

• Age and years of schooling were good predictors of final grade. 

• The VPD appears to be a worthwhile addition to the selection 
battery when the decision is made to accept low-Average or marginal 
personnel into the course. 

• The VPD, when used as an "orienting task" at the training level, 
should facilitate learning to receive code visually. 

• Consideration should be given to lowering the cutoff score for 
entry into the signalman course. Of the trainees comprising the 
sample, 23 had combined WK + AR scores below the 105 cutoff for 
course entry. Visual discrimination ability apparently compensates 
to some extent for cognitive ability. 

• The implementation of innovative learning strategies may provide a 
wider base for personnel selection. 
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• Attrition and setbacks appear to be more a motivational than an 
academic problem since there were no statistically significant 
differences in aptitudes between those who succeeded and those who 
failed. 

RECOMMENDATIONS 

Based on the findings of this study, it is recommended that: 

• the Visual Pattern Discrimination pretest be added to the selection 
battery for improved screening of Average and Low-aptitude individuals 
considered for the signalman course 

• the instructional model delineated in section IV be adopted for 
training signalmen to include: 

instructional materials containing guided learning and practice 
plus mnemonics 

self -paced instruction to accelerate the learning of High aptitude 
trainees and permit low^r aptitude trainees sufficient time to 
attain task mastery 

the VPD test as an "orienting task" to facilitate code reception 
via flashing light. 
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APPENDIX A 



DESCRIPTION OF ARMED SERVICES VOCATIONAL 
APTITUDE BATTERY 
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DESCRIPTION OF 
ARMED SERVICES VOCATIONAL APTITUDE BATTERY (ASVAB) 

♦Reliability 
Administration Coefficients 



Test 


ID 


Items 


Time (Mins) 


Form 6 


Form 7 


General information 


GI 


20 


7 


.60 


.59 


Numerical operations 


NO 


50 


3 


- 


- 


Attention to detail 


AD 


30 


5 


- 


- 


Word knowledge 


WK 


30 


10 


.89 


.86 


Arithmetic reasoning 


AR 


20 


20 


.80 


.79 


Space perception 


SP 


20 


12 


.75 


.80 


Mathematical knowledge 


MK 


20 


20 


.83 


.82 


Electronics information 


EI 


30 


15 


.81 


.78 


Mechanical comprehension 


MC 


20 


15 


.76 


.74 


General science 


GS 


20 


10 


.69 


.75 


Shop information 


SI 


20 


8 


.78 


.76 


Automotive information 


AI 


20 


10 


.81 


.84 






300 


2 hrs 15 min 


N=417 


N=400 



(aprx) 



Armed Forces Qualification Test: There is no AFQT. However, an AFQT score 
(percentile) can be configured from the ASVAB utilizing the WK, AR, SP 
raw scores to place the individual in a mental group for statistical 
purposes. 



*Kuder-Richardson Formula (untimed tests). Total sample size, form 6 = 417, 

form 7 = 400 (males){preselected groups across three Navy Training Centers). 
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TABLE B-1 


. TYPES OF TRAINING MATERIALS 




Trainina Material* 


Type 
1 


Type Type 

>- >j 


Type 
4 


1. Hand-held code 

flasher (cardboard) 


X 






2. Symbol cards 
(Opposites) 


X 






3. Practice assignment 


X 






4. Symbol sheet 


X 






5. Guided learning and 
practice 




X 


X 


5. Self-test 




X 


X 


7. Chunking 




X 


X 


8. Memory aids 
(mnemonics) 




X 


X 



♦Description of types of materials: 

1. Hand-held code flasher: Slitted cardboard with movable white center 
which can be pushed up and down to expose white center representing 
flashing light. Speed differentiation can be manipulated to represent 
dots and dashes. 

2. Symbol cards: Set of seven flash cards containing Morse code symbols. 
Each card indicating letter, the symbol and a letter and symbol which 
are opposite; .- for A and -. for N. 

3. A sheet of paper assigning Morse code symbols to be identified and handed 
in to the instructor at the next class. No attempt is made to structure 
the learning process. 

4. A sheet of paper containing the alphabet and Morse code equivalents. 

5. Programmed text with learning guidelines and practice exercises. 

6. Self- test: A criterion test with branching for repeated practice. 

7. Chunking: Code is divided into sets— four sets of letters, one set 
each of numbers and punctuation marks. The sets are sequenced and 
become progressively more difficult. 
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Memory aids: Mnemonics (visual images) constructed to assist in learning 
to associate the alphanumerics with the symbol. These are associated 
with the phonetic alphabet. 
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APPENDIX C 



INSTRUCTIONS TO STAFF AND TRAINEES 
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PATTERN DISCRIMINATION EXERCISE 
INSTRUCTIONS 



As signalmen you will be required to identify dots and dashes presented 

by a flashing light. This exercise is to see how well you can distinguish 

patterns of dots and dashes. Dots are of shorter duration than dashes. This 

is a D 0 T (flash several dots). This is a D A S H (flash several dashes). 

You will be presented a number of sets of dots and dashes. You are to 
repeat the patte»..s on the scoring sheet I have just given you. 

I will now present two practice sets. Look at the light and repeat on 
your answer sheet the pattern you see. (Use numbers one and two.) 

Now look at the light and remember the sequence of dots and dashes. When 
I say "STOP," repeat the pattern on your answer sheet. 

(Repeat directions for practice trial number two.) 

"You should have as your first answer . and for your second 

answer. Now each time I say START, observe the dot-dash pattern closely. 
When I say STOP, repeat the pattern on your answer sheet. 
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ANALYSIS OF VARIANCE SOURCE TABLES 
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TABLE D-1. ANOVA SOURCE TABLE FOR "SENDING" DATA, ACQUISITION PHASE 



Source of Variation 


Sum of Squares 


df 


Mean Square 


F 


P 


A: Aptitude 


1438.67 


1 


1 438 . 67 


27.71 


.0001 


B: Treatment 


2324.76 


3 


774.92 


14.93 


.0001 


A X B 


475.07 


3 


158.36 


3.05 


.03 


S(AB): Error (a) 


7891.95 


152 


51.92 






C: Trial 


5877.65 


2 


2938.82 


176.47 


.0001 


A X C 


238.96 


2 


119.48 


7.17 


.001 


B X C 


780.21 


6 


130.04 


7.81 


.0001 


A X B X C 


70.67 


6 


11.78 


.71 


ns* 


S{AB) X C: Error (b) 


5062.50 


304 


16.65 






Total 


24160.44 


479 









*ns = nonsignificant 



TABLE D-2. ANOVA SOURCE TABLE FOR "RECEIVING" DATA, ACQUISITION PHASE 



Source of Variation 


Sum of Squares 


df 


Mean Square 


F 


P 


A: Aptitude 


4392.30 


1 


4392.30 


51.85 


.0001 


B: Treatment 


1947.74 


3 


649.25 


7.66 


.0001 


A X B 


862.45 


3 


287.48 


3.39 


.02 


S{AB): Error (a) 


12876.77 


152 


87.72 






C: Trial 


16397.00 


2 


8198.50 


396.67 


.0001 


A X C 


481.36 


2 


240.68 


11.65 


.0001 


B X C 


346.04 


6 


57.68 


2.79 


.02 


A X B X C 


165.79 


6 


27.63 


1.34 


ns* 


S(AB) X C: Error (b) 


6283.13 


304 


20.67 






Total 


43752.58 


479 









*ns = nonsignificant 
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TABLE D-3. ANOVA SOURCE TABLE FOR FLASHING LIGHT DATA, PERFORMANCE PHASE 



Source of Variation 


Sum of Squares 


df 


Mean Square 


F 


P 


A: Aptitude 


4914.11 


1 


"T 

4914.11 


24.31 


.0001 


B: Treatment 


1274.34 


3 


424.78 


2.10 


ns*{p=.10) 


A X B 


700.74 


3 


233.58 


1.16 


ns* 


S{AB): Error (a) 


30723.70 


152 


202.13 






C: Trial 


2587.81 


1 


2587.81 


52.35 


.0001 


A X C 


10.51 


1 


10.51 


.21 


ns* 


B X C 


68.84 


3 


22.95 


.46 


ns* 


A X B X C 


124.14 


3 


41.38 


.84 


ns* 


S(AB) X C: Error (b) 


7513.70 


152 


49.43 






Total 


47917.89 


319 









*ns = nonsignificant 
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STRENGTH OF OBTAINED DIFFERENCES— STATISTICS 
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STRENGTH OF THE OBTAINED DIFFERENCES 

The occurrence of a significant result says nothing at all about the 
strength of the association between treatment and scores obtained by trainees. 
A significant result leads to the inference that some association exists, but 
in no sense does this mean that an important degree of association necessarily 
exists. This can be misleading to the organization in determining the prac- 
tical significance of the results. 

To reinforce the meaning of the significant findings obtained in this 
study, an estimate of the strength of the statistical association was computed. 

ihe eta squared was computed to obtain a population index showing the relative 
or proportional reduction in the variance of Y (the dependent variable) given 
the X (independent variables) status or value of the observations. The index 
reflects the predictive power afforded by the relationship. In order to 
nf^Hont uncertainty; i .e. .determine the extent to which knowing the ipde- 
S^^SL^"'^ (t^^atments) reduce the uncertainty about the dependent 
llVt H ?5 I"^' "receiving," acquisition, flashing light, and performance, 
eta squared (Petgrs and Van Voorhis, 1940), which is an unbiased estimate of 
^«ct?2^jr^f^!:^ discussed in Hays (1963, p. 325), was used to detennine 
an estimate of the proportion of variance accounted for by treati.ients The 
proportion of variance accounted for by treatment/"send" sc res was .19, for 
treatment/ receive" scores. .18, and treatment/performance scores was 08. 

A%n^?J pbtained were 4388 {V^ = .1926) for "send," 

.4290 {Ti^ = .1841) for "receive" and .2851 {V^ = .0813) for flashing light 
performance. The estimates imply that the statistic ^association is moderate 
between treatment and "send" and "receive" acquisitio scores and minimal for 
performance. 

Data were also analyzed to determine the statistical significance of the 
multiple correlations of the variables added to the currently used two-variable 
model. The difference between the multiple correlations for the two- and 
four-variable models for FLl was not significant. The difference between the 
correlations for the two- and four-variable models for FL2 was significant 
l£ = <.01). The difference between the correlations for the two- and four- 
variable models for FL3 was significant (£ =<.05). The difference between the 
correlations for the two- and four-variable models for FSG was significant 
;L~nS;(i,- VJ' ' These significant differences indicate that 

the addition of these variables to the selection battery would improve the 
selection procedure. 
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